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THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time maybe available under the provisions of 37 CFR 1.136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 
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earned patent term adjustment. See 37 CFR 1 .704(b). 
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I )□ Responsive to communication(s) filed on . 

2a)n This action is FINAL. 2b)M This action is non-final. 

3) n Since this application is in con(jition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 
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4) M Claim(s) 1-11 is/are pending in the application. 
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5) n Claim(s) is/are allowed. 

6) 13 Claim(s) 1-11 is/are rejected. 
/)□ Claim(s) is/are objected to. 

8) n Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10)13 The drawing(s) filed on 27 December 2000 is/are: a)|3 accepted or b)n objected to by the Examiner. 
Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

I I )□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or fonri PTO-152. 
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application from the International Bureau (PCT Rule 17.2(a)). 
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DETAILED ACTION 
Response to Amendment 

1 . In response to the Office Action mailed September 4, 2003, applicants submitted 
an Amendment filed on March 2, 2004, amends the Specification and claims 1,10 and 

1 1 , arguing that this makes them distinguishable over the prior art cited. 

Response to Arguments 

2. Applicant's arguments with respect to claims 1 , 10 and 1 1 , have been considered 
but are moot in view of the new ground(s) of rejection. Applicant amended the claims 
to add that the speech synthesizing apparatus comprises a text generating means for 
generating text in response to a behavior event. 



Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



4. Claims 1-11 are rejected under 35 U.S.C. 103(a) unpatentable over Sadakuni 
(U.S Patent No. 6,446,056) in view of Holm et al. (U.S. Patent No. 6,260,016), 
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hereinafter referenced as Holm in further view of Tackett et al. (U.S. Patent No. 
6,363,301), hereinafter referenced as Tackett. 

Regarding claim 1,10 and 11 Sadakuni discloses and interactive artificial 
intelligence comprising: 

a behavior planning unit (Figure 1, element 7), which reads on the claimed 
"behavior-state changing means", responsive to a behavior event (column 8, lines 37-38 
and 41-53), for changing a behavior state according to a behavior model (behavior 
modified by emotion; figure 3, element g and figure 12 with column 1 , lines 40-43); 

an emotion-generating unit (Figure 1, element 3), which reads on the claimed 
"emotion-state changing means" for changing an emotion according to the emotion 
model (figure 12); and 

selecting means selecting control information according to at least one of the 
behavior state (attack; column 5, lines 21-25) but Sadakuni lacks synthesizing means 
for synthesizing a speech signal and a text generating means for generating text in 
response to said behavior event. 

Holm discloses synthesizing means (figure 1) for synthesizing a speech signal 
(column 4, lines 8-23), to generate a pronunciation of the word. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such it discloses 
synthesizing means for synthesizing a speech signal, to generate synthesized speech, 
wherein the normally missing prosody information is supplied from the templates based 
on data extracted from human speech (column 8, lines 61-65), to provide more natural 
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sounding prosody through the use of prosody templates (column 1 , lines 6-9) but Holm 
lacks a text generating means for generating text in response to said behavior event. 

Tackett discloses a text generating means for generating text (column 20, lines 
58-60) in response to said behavior event (user's language inappropriate, so user is 
kicked off the system by the robot; column 33, lines 8-12), to improve the robots 
behavior. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni and Holm with a text generating 
means for generating text in response to said behavior event, to allow the robot to learn 
from interaction with user and improve its own behavior, as taught by Tackett (column 2, 
lines 65-67). 

Regarding claim 2, Sadakuni discloses an interactive artificial intelligence device 
but lacks including at least one of a segment-data ID, a syllable-set ID, a pitch 
parameter, a parameter of intensity of accent, a parameter of intensity of phrasify, and 
an utterance-speed parameter. 

Holm discloses a speech synthesis system including at least one of a segment- 
data ID, a syllable-set ID (syllables enunciated), a pitch parameter (pitch rises and falls), 
a parameter of intensity of accent, a parameter of intensity of phrasify (intensity of 
syllables; column 2, lines 20-30), and an utterance-speed parameter (speech rate; 
column 8, line 49), to convey the reader's interpretation of the material. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such that it includes at 
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least one of a segment-data ID, a syllable-set ID, a pitch parameter, a parameter of 
intensity of accent, a parameter of intensity of phrasify, and an utterance-speed 
parameter, to insure a natural prosody, as taught by Holm (column 9, lines 11-16). 

Regarding claim 3, Sadakuni discloses an interactive artificial intelligence with 
detecting means for detecting external conditions (Figure 3, step a and column 9, lines 
10-19). 

Regarding claim 4, Sadakuni^s interactive artificial intelligence discloses holding 
means for holding individual information (column 6, line 32 and column 5, lines 31-43). 

Regarding claim 5, Sadakuni's interactive artificial intelligence discloses counting 
means for counting elapsed time (column 4, lines 20-42) 

Regarding claim 6, Sadakuni discloses an interactive artificial intelligence device 
comprising at least one of the number of accumulating means for accumulating the 
number of times the behavior and emotion state changes (column 2, 1 4-1 9 and lines 
58-61). 

Regarding claim 7, Sadakuni discloses an interactive artificial intelligence, but 
lacks comprising substituting means for substituting words included in the text. 

Holm discloses substituting means for substituting words included in the text 
(substitute word; column 9, lines 7-11), to insure a natural prosody. 

Therefore, it would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's invention such that it discloses 
substituting means for substituting words included in the text, for providing more natural 
sounding prosody through the use of prosody templates. 
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Regarding claim 8, Sadakuni discloses an interactive artificial intelligence but 
lacks the converting means for converting the style of the text. 

Holm discloses converting means for converting the style (prosody) of the text 
(column 1 , lines 29-44). 

Therefore, It would have been obvious to one of ordinary skill in the art at the 
time the invention was made to modify Sadakuni's speech synthesizing apparatus 
method and recording medium, for the purpose of supplying the system with requisite 
information concerning the number of syllables and stress patterns that fit the given 
emotion. 

Regarding claim 9, Sadakuni an interactive artificial intelligence that is a robot 
(column 1, lines 48-51 and column 18, lines 6-7). 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

The following patents are cited to further show the state of the art with respect to 
speech apparatus's in general: 

U.S. Patent Number 5,615,301 to Rivers discloses an automated language 
translation system. 

U.S. Patent Number 6,675,144 to Tucker et al. discloses audio coding systems 
and methods. 



Application/Control Number: 09/749,345 



Page 7 



Art Unit: 2655 

6. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jakieda R Jackson whose telephone number is 
703.305.5593. The examiner can normally be reached on Monday through Friday from 
7:30 a.m. to 5:00p.m. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis I. Smits can be reached on 703. 306-301 1 . The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



JRJ 

May 17, 2004 
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